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In this paper, a very useful lemma (in two versions) is proved: it simplifies 
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notably the essential step to establish a Lindeberg central limit theorem 
for dependent processes. Then, applying this lemma to weakly dependent 
processes introduced in Doukhan and Louhichi (1999), a new central limit 
theorem is obtained for sample mean or kernel density estimator. Moreover, by 
£NJ , using the subsampling, extensions under weaker assumptions of these central 

qq , limit theorems are provided. All the usual causal or non causal time series: 

Gaussian, associated, linear, ARCH(oo), bilinear, Volterra processes,. . ., enter 
£**». . this frame. 
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1. Introduction 

This paper adresses the problem of the central limit theorem (C.L.T.) for weakly dependent se- 
quences with the point of view of the classical Lindeberg method (see Petrov, 1995, for references). 
For establishing a C.L.T. for a sequence (SVOneN* of random vectors (r.v.), a convenient and efficient 
method (so-called the "Lindeberg's method" in the sequel) consists on proving that for all functions / 
with bounded and continuous partial derivatives up to order 3, 

E(/(Sn) - f(N)) — 0, (1) 

n — >oo 
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with N a Gaussian random variable not depending on n. Assume that S n = X± + ■ ■ ■ + X n where 
(Xk)keN* is a zero-mean sequence with (2 + <5)-order finite moments for some 5 > 0, and consider 
{Yk)keN* a sequence of independent zero mean Gaussian r.v. such that the variance of Yk and X/, are 
the same. In order to obtain (1), we first show that this convergence is satisfied when the sum of two 
terms converges to zero. The first term is the sum of the (2 + (5)-ordcr moments of {Xj-)i<k<n- The 
second term is a sum of covariances between functions of (Xk)i<k<n and (Yfc)i<fc<„ and reflects all 
the dependence structure. Three cases are thus detailed in three different lemmata: first, the case of 
independent r.v.s (here, the second term vanishes), then the dependent case with general functions /, 
and finally the dependent case with characteristic functions that yields a very simple expression. 

For applications of those lemmata, the class of weakly dependent processes, introduced by Doukhan 
and Louhichi (1999), is selected here. Roughly speaking, a process X = (Xk)keN' is said to be a 
weakly dependent process if the covariance of any bounded and Lipschitz function of " past" data of 
X by any bounded and Lipschitz function of " future" data of X tends to when the lag between the 
future and the past increases to oo (see a more precise definition below). 

Why should we use such dependence structures (instead e.g. mixing)? 

Two main reasons motivate this choice. Firstly, weak dependence is a very general property including 
certain non-mixing processes: e.g. Andrews (1984) explicited the simple example of an autogressive 
process with Bernoulli innovations and proved that such a model is not mixing in the sense of Rosenblatt 
(see for instance Doukhan, 1994, or Rio, 2000, for references) while Doukhan and Louhichi (1999) 
proved that such a process is weakly dependent. More generally, under weak conditions, all the usual 
causal or non causal time series are weakly dependent processes: this is the case for instance of 
Gaussian, associated, linear, ARCH(oo), bilinear, Volterra, infinite memory processes, — Secondly, 
the dependence property is obtained from the convergence to zero of covariances of the process (see 
above). The second term in our lemmata writes as a sum of covariances; weak dependence is therefore 
particularly accurate to bound this term (which is the essential step for proving the Lindeberg C.L.T.). 

Different applications of the lemmata are then presented for weakly dependent processes. First, a 
C.L.T. for sample means is established in Doukhan and Wintenberger (2006); in addition to the 
previous lemma for characteristic function, the Bernstein block method is required (in such a case, 
Bulinski and Shashkin, 2004 and 2005 used also this method; an alternative method is derived in Rio, 
2000, Coulon-Prieur and Doukhan, 2000, or Neumann and Paparoditis, 2005). For weakly dependent 
processes, a C.L.T. for the subsample mean is derived here directly from our lemmata. By this way, 
the conditions required for such a theorem are weaker than those required for the C.L.T. for the sample 
mean. For instance, the subsampling of a long range dependent process provides a C.L.T. for its sample 
mean, which is interesting for obtaining confidence intervals or semi-parametric tests (even if a large 
part of the sample is not used). 
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Finally, an application of the Lindeberg method to the kernel density estimation is also given. By this 
way, the C.L.T. is established under the same conditions (but with a more simple a nd genral method) 
than in Coulon-Prieur and Doukhan (2000) for causal processes. Its extension to non-causal processes 
is also proposed here. The required conditions are of a different nature that the usual conditions under 
strong mixing (see Robinson, 1983); but on some examples of time series (for instance, the causal 
linear processes) they imply the same decay rates of the coefficients. On other examples (some non- 
causal time series), it is very difficult to check the strong mixing property. Therefore the C.L.T. we 
proved concerns a lot of new models. Moreover, a version of this C.L.T. for subsampled kernel density 
estimator is given. Once again, this allows to obtain a C.L.T. under weaker conditions. With an 
adapted subsampling step, the asymptotic normality of this estimator is established even in the case of 
long memory processes, which provides usual confidence intervals on the density or goodness-of-fit tests. 



The paper is organized as follows. In Section 2, the Lindeberg method is presented. The Section 
3 is devoted to a presentation of weakly dependent processes. Section 4 contains different applications 
of the Lindeberg method for weakly dependent processes while the proofs of the different results are 
in the Section 5. 



2. Lindeberg method 

Let (Xj)jgN be a sequence of zero mean r.v. with values in M. d (equipped with the Euclidean norm 
||Xi|| 2 = Xf i + • • • + Xf d for Xi = (X^i, . . . , X it d))- Moreover, all along this paper we will assume 
that {Xi)i£n satisfies, 



Assumption H s : It exists < S < 1 such that Vi G N, E||X,|| 2+<5 < oo and Vfc g N*, define 

k 

A k = Y,m\x*\\ 2+s . (2) 

Let (Yi)ieN be a sequence of zero mean independent r.v. with values in R d , independent of the sequence 
(Xi)igN and such that Yi <~ 7Vd(0, CovXj) for all i g N. Denote by the set of bounded functions 
M. d — > R with bounded and continuous partial derivatives up to order 3. Set, for / g Cf and k g N*, 



A k = 



E(f(X 1 + ... + X k )- f{Y 1 + ■■■ + ¥„)) (3) 



Following the dependence between vectors Xi , we now provide 3 lemmata, the first one is well known 
and relates to the independence case, the two others are concerned with the dependence case. Thus, 
first, for independent random variables, the Lindeberg lemma (see e.g. Petrov, 1995) is 

Lemma 1. (Lindeberg under independence.) Let (Xi)^ be a sequence of independent zero mean r.v. 
with values in R d satisfying Assumption Hs. Then, for all k g N*: 

A fe <3.||/( 2 )||L- 5 -||/ (3) ||fo-^- 
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This lemma is restated for completeness sake but it is essentially well known. 

Remark 1. Using the proof of the previous Lemma, classical Lindeberg conditions may be used: 

A fc < ||/< 2 >||ooi? fc (e) + ||/ (3) ||oo ■ a k (| e + \ y/B^efj , (4) 

k 

where B k {e) = ^ e(||X 4 || 2 1 { || Xi || >£} ) , for e > 0, k e N, (5) 



i=i 
k 

a k = ^E(||X,|| 2 ) < oo, for ke N. 

i=i 



Moreover, these classical Lindeberg conditions derive those from Lemma 1; indeed, according to Holder 
Inequality, E(||Xj|| 2 :iL { || X .|| >e} ) < (e(\\X 1 \\ 2+s )^ (p(\\X t \\ > ^ , and then, using the Bienayme- 
Tchebichev inequality, for all S e]0, 1[, B k (e) < e~ s A k . Consequently (4) implies, 

A fe < ||/ (2) |U£- 5 A fc + ||/(3)|| oo0fc (H e+ le-Va^. 
For the dependent case, the Lindeberg method provides the two following lemmata. First, for random 
vectors W = {W\, . . . , Wd)' and X = {X\, . . . , X d )' e M d , we will use the notations, 
Cov{fW(W),X) = ^Cav(^-(W),Xt 



=i 

d d 



Co^(W),X 2 ) = EECov(^-(M/), M ). 

Assume that X* is independent of W and admits the same distribution as X; the previous expression is 
rewritten Cov(f^(W), X 2 ) = Ef^(W)(X,X)-Ef^{W)(X*,X*) where f {2 \W) is here considered 
as a quadratic form of R d . Then, 

Lemma 2. (Dependent Lindeberg Lemma - 1.) Let (Xj)j £ N be a sequence of zero mean r.v. with values 
in R d satisfying Assumption H$. Then, 

A fc < T x {k) + \ T 2 (k) + 6 • \\f^ s • \\f^\\L • A k , 

where (empty sums are set equal to 0), 

k 

T A k ) = J2\ Cov (f {j) ^+--- +x ^' x i)[ i = 1 ' 2 ' (6) 

i=l 

Characteristic functions are considered below; they provide a simpler result 

Lemma 3. (Dependent Lindeberg Lemma - II.) Let (XA^ be a sequence of zero mean r.v. with values 
in M. d satisfying Assumption Hg. For the special case of complex exponential functions f(x) = e l<t,x> 
for some t <G K d (and where < a,b> is the scalar product in R d ), 

k 

A fc <T{k) + 3\\t\\ 2+5 A k , where T(k) = ^ | Cov{e i<t ' Xl+ - +x ^- 1> , e l<t '^>)|. 
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The main consequence of those three lemmata is related to the asymptotic behavior of J2i=i ^i, and 
provide sufficient conditions for establishing the C.L.T. 

Theorem 1. (a Lindeberg C.L.T..) Assume that the sequence {X it k)ien satisfies Assumption H$, and 

k 

Ak — ► 0, and there exists £ a positive matrix such that Efe = Cov[X^k) — > £• Moreover, 
assume that Tj(k) — ► for j = 1,2 (Lemma 2) or T (k) — ► (Lemma 3). Then, 

k— >oo k^oo 



E(/(S fc )-/(JV fc )) 



— > 

fe — >oo 



Proof of Theorem 1. Under the assumptions of this Theorem, it is clear that 
for all functions / e C^, or for all t G R and /(x) = e ttx , where N k ~ 7Vd(0, S fc ). According to 
E(/(JVfc) - /W) — » where N ~ A/" d (0,E), we deduce that E(f(S k ) - f(N)) — » and 

fc— 'CO /c— -co 

therefore 5 fe iV. □ 

Following this theorem, we can remark that the condition A(k) — ► is the usual Lindeberg condition 

k^co 

(with also condition Sfc — ► E, the convergence of variances), while the conditions Tj(k) — > (for 

k^oo k^oo 

j = 1, 2) or T{k) — ► are related to the dependence structure of the sequence (Xi) ie ^. 

k^oo 

3. Weakly dependent processes 

We have just seen that the convergence in distribution of Sk to a Gaussian law is obtained if Ti(fc) 
and T?,(k), or T(/c) converge to 0. Those terms are related to the dependence of the sequence {X n ) n( z^. 
Now, we address a very general class of dependent processes introduced and developpcd in Doukhan 
and Louhichi (1999). Numerous reasons justify this choice. First, this frame of dependence includes 
a lot of models like causal or non causal linear, bilinear, strong mixing processes or also dynamical 
systems. Secondly, these properties of dependence are independent of the marginal distribution of 
the time series, that can be as well a discrete one, Lebesgue measurable one or else. Finally, these 
definitions of dependence can be easily used in various statistic contexts, in particular in the case of 
the establishment of central limit theorems, since the previous bounds provided for T\{h), T^(k) or 
T(k) are written with sums of covariances (see above). 

To define a such dependent processes, first, for h : (R d ) u — > R an arbitrary function, with d, u G N*, 
denote, 

t • , \h(yi,...,y u )-h(xi,...,x u )\ 
Lip ft = sup — r — . 

(yi,...,yu)^(xu...,x u )e(K d y 1 1 2/1 ^1 1 1 ^ H|j/u-£u|| 

Then, 

Definition 1. A process X = (X n ) ne z with values in R d is a so-called (e, -0)-weakly dependent process 
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if there exist a function ip : (N*) 2 x (R+) 2 — ► R+ and a sequence (e r ) r6 N such that e r — ► satisfying, 

r^oo 

Cov^ipQj,. . . ,X iu ),flr 2 (-^ji, ■ • -,Xj v )) < i>{u,v,\AV9iMV92) • £ r (7) 



for all < 



• (u,v) efx N*; 

• (ii, . . . ,i u ) e Z" and (ji, . . . ,j„) e Z" with ii < • • • < i u < i u + r < j x < ■ ■ ■ < j v 

• functions g 1 : R ud — > M and ,g 2 : R vd — > M such that 

IIPilU < 1, 1 1 .92 1 1 oo < 1, Lip 5i < oo and Lip g 2 < oo; 

In the sequel, two different particular cases of functions ip corresponding to two different cases of 
weakly dependent processes will be considered (more details can be found in Doukhan and Louhichi, 
1999, Doukhan and Wintenberger, 2006), 

• If X is a causal time series, i.e. there exist a sequence of functions (F n ) and a sequence of 
independent random variables (£,k)k& such that X n = F n (£ n ,£ n —i, . . .) for n € Z, the 0-weakly 
dependent causal condition, for which 

V>(u,v,Lip 3i, Lip g 2 ) = v ■ Lip g 2 

(in such a case, we will simply denote 8 r instead of e r ). 

• If X is a non causal time series, the A-weakly dependent condition, for which 

ip(u, v, Lip 3i, Lip g 2 ) =u-v ■ Lip g x ■ Lip g 2 + u ■ Lip gi + v ■ Lip g 2 

(in such a case, we will simply denote A r instead of e r ). 

Remark 2. It is clear that if X is a 6- weakly dependent process it is also a A-weakly dependent 
process. The main reasons for considering a distinction between causal and non causal time series 
are: a/ the #-weak dependence is more easily relied to the strong mixing property; b/ some models or 
properties require different conditions on the convergence rate of (9 r ) than for (A r ). 

Note first that sums of independent weakly dependent processes admit the common weak dependence 
property where dependence coefficients are the sums of the initial ones. We now provide a non 
exhaustive list of weakly dependent sequences with their weak dependence properties. In the sequel, 
X = (Xk)kez denote a weakly dependent stationary time series (the conditions of the stationarity will 
not be specified) and (£„)„gz is a sequence of zero mean i.i.d. random variables, 

1. If X is a Gaussian process and if lim Cov(Xq, X,) = 0, then X is a A-wcakly dependent process 

i — >oo 

such that A r = 0[ sup |Cov(X , Xi)\ J (see Doukhan and Louhichi, 1999). 

2. If X is an associated stationary processes, then X is A-weakly dependent process such that 
A r = Ol sup Cov(X , Xi)) (see Doukhan and Louhichi, 1999). 

^ i>r ' 
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3. if X is a ARMA(p, q) process or, more generally, a causal (respectively, a non causal) linear pro- 

oo oo 

cess such that X k = ^ a jCfc-j (respectively, Xk = ^ a j£,k-j) for k e Z, with a k = 0(|£;|~ M ) 

j=o j=-oo 

with yu > 1/2, then X is a 0- (respectively, A-) weakly dependent process with r = A r = (9( — ^ ) 
(see Doukhan and Lang, 2002, p. 3). It is also possible to deduce A-weak dependence properties 
for X if the innovation process is itself A- weakly dependent (Doukhan and Wintenberger, 2006). 

4. if X is a GARCH(p, q) process or, more generally, a ARCH{oo) process such that X k — p k ■ £fc 

oo 

with p\ — b + ^ bjXl_j for k E Z and if, 

• it exists C > and p e]0, 1[ such that Vj e N, < bj < C ■ p,~ j , then I is a A- 
weakly dependent process with A r = C(e~ Cv/? ) and c > (this is the case of GARCH{p,q) 
processes). 

• it exists C > and > 1 such that Vj e N, < 6j < C • then X is a A-weakly 
dependent process with A r = 0(r^ u+1 ) (see Doukhan et al, 2005). 

oo oo 

5. if X is a causal bilinear process such that Xk = £fc (a + ^ ajX^-^j + c + ^ CjXk-j for fc e Z 
(see Giraitis and Surgailis, 2002) and if, 

3J G N such that Vj > J, a, = = 0, or, 

, then X is a A-wcakly de- 

3/i e]0, 1[ such that £\ Ic,^"- 3 ' < 1 and Vj e N, < a,- < /U j 
pendent process with X r = 0{e~ c ^), constant c > 0; 

• Vj e N, Cj > 0, and 3z/i > 2 and 3z/ 2 > such that aj = 0{j~ Vl ) and '£ j c j j 1+U2 < 
oo, with d = max ^ — (i>i — 1) ; — (f2<5)(<5 + ^2 log2) -1 ^ , then X is a A-weakly dependent 
process with A r = o((j—— ) d ) and (see Doukhan et al, 2004). 

6. if X is a non causal bilinear process satisfying X k = £ k • ^a + ^ ajX k -j^, for k e Z, where 

||£o||oo < 00 (bounded random variables) and a k = 0(|fc| _M ) with p > 1, then X is a A-weakly 
dependent process with A r = C(r 1_A1 ) (See Doukhan et al, 2005). 

7. if X is a non causal finite order Voltcrra process such that Xk = Y^Li Y k P ^ f° r & € Z, and 
with = ^ j p £ k -h ' ' '£k-j p and such that it exists p € N* satisfying 

-oo<ji<j 2 <---<i P <oo 

for p > p , a£] jp = 0. Then if a { ^] Jp = o( max ->*}) with /x > 0, X is a A-weakly 



l<i<p 



dependent process with A r = 0( — — ) (See Doukhan, 2003). As in case 3, A-wcak dependence 
properties for X may be proved even for A-weakly dependent innovations. 

8. if X is a causal (respectively, non causal) infinite memory process such that 



X k =F(X k - 1 ,X k - 2 ,...;£ k ) (respectively, X k = F(X k _ t , t ^ 0;&)) for k eZ, 
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where the function F is defined on R N (respectively, M z ) and satisfies, with m > 0, ||.F(0; £o)||m < 
oo and ^((a;^; £ ) - F^y^j; £ )\\ m < J2 3 ^o a i\ x j - Vjl whcre a = T,j^o a j < L Thcn X is 
a 9- (respectively, A-) weakly dependent process with 9 r = inf p >i ja? +X^> P a j} (respectively, 
A r = inf p >i jap + J2\j\> P a j}) ( scc Doukhan and Wintenbcrgcr, 2006). 

9. let A be a zero-mean, second order stationary Gaussian (or linear) process. Assume that A 
is long-range dependent: Cov(A ,A fe ) = L(k) ■ k 2H ~ 2 for k G N, with H G (1/2,1) (so-called 
Hurst parameter) and L(-) a slowly varying function (at +oo). Then, X is a A- weakly dependent 
process with A r = L(r) ■ r 2H ~ 2 . 

Now, different applications of Theorem 1 are considered for weakly dependent processes. 



4. Applications under weak dependence 



4.1. Lindeberg Central Limit Theorem 

Doukhan and Wintenberger (2006) prove a C.L.T. using Bernstein blocks for a sequence (Aj)j £ N of 
stationary zero mean (2 + <5)-order random variables. In order to prove T(k) — ► (see Lemma 3), 

k— >oo 

we consider two sequences (p„)„ e N and {q n ) n m such that, 



p n > OO 

q n — ► oo 

fc— 'CO 



and p n = o(n), q n = o(p n ). 



Introduce now the number of Bernstein blocks k n = 



Pn + q n 



. It can be shown that if p n ■ q n = o(n), 



7^X>-^E E x * 

V »=1 V j=l »=C7'-l)(Pn+9»)+l 



0. 



Therefore, it is sufficient to prove the convergence in distribution to a Gaussian law of the second sum, 
which is easier than with the first one. Thus, Doukhan and Wintenberger (2006) prove a (2 + <5)-order 
moment inequality which entails condition A(k n ) — > and T(k n ) — ► 0, and they obtain: 

Theorem 2. Let (A,)j £ N be a sequence of stationary zero mean (2 + 5)-order random variables (with 

5 > 0). Assume that (Aj)i £ N is a A- (or 9-) weakly dependent time series satisfying X r = 0(r~ c ) (or 

1 ™ v 

9 r = 0(r~ c ) ) when r — > oo, with c > 4+2/6, then it exists < a 2 < oo such that —= } Aj > A/Y0, a 2 ). 

Note that in Doukhan and Wintenberger (2006) the Donsker principle is also proved. 
4.2. Subsampling 

Assume that (Aj)j £ z is a zero mean (2 + <5)-order stationary sequence for some S > 0, with £ = 
Cov(Ap). Then, for a sequence (m„)„ £ N such that m„ — ► oo and k n — [n/m„] — ► oo. We 
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consider a subsamplc (X mn , . . . , X kn „ ln ) of (Xi, . . . , X n ), and the sample, 

(Yi,„, . . . , Y knin ) with F i; „ = — \= X imn for 1 < i < k n . 

\/kn. 



Depending on the weak dependence property of (Xi)i e %, we can obtain the Lindeberg Theorem for 



fer, 



Proposition 4.1. Assume that (Xi) ie z is a zero mean (2 + 5)-order stationary sequence for some S > 
7 with E = Cov(X )- Then, for a sequence (m„)„ £ N such that m n ► oo and k n — [n / m n ] — > oo, 



n^oo 



1 kn V 

Sk n .n = —7= ^^im„ > A/d(0, £), 

if one of the following assumptions also holds, 

• (Xi) ie z is a 9— weakly dependent sequence and 6 mn \/k^ — ► 0. 

n^oo 

3 

• (Xj)j e z «s a \— weakly dependent sequence and X mn kn > 0. 



n— >oo 



This proposition allows to pass from a situation where the C.L.T. is not satisfied to a situation where 
it is satisfied by using a subsample with the correct asymptotic step of sampling. For instance, if X is 
a zero mean stationary long range dependent (2 + 5)-order process (with 6 > 0) and such that a/ X is 
a Gaussian process such that E(X X n ) — 0(n 2H ~ 2 ) with 1/2 < H < 1 when n — > oo or b/ X a linear 
process. Then X is a A- weakly dependent process with A r = 0(r 2H ~ 2 ) and it is well known (see for 
instance Taqqu, 1975) that X does not satisfy a usual central limit theorem. As a consequence, with 
a subsampling step m n such that o(m n ) = n 3 ^ 4 ^ 1 ), the subsampled time series (Xj mn ) satisfies a 
usual C.L.T. with a convergence rate o(n( 1 ~ H ^( 4H ~ 1 ' 1 ). 



Two objections can be raised to this method: first, only a part of the sample is used. The second and 
main objection is that the choice of the convergence rate of the subsampling implies the knowledge of 
the convergence rate of (A r ) or (9 r ). However, an estimation of this last rate (for instance in the case 
of long-range dependence) could provide an estimation of a fitted step of subsampling, or in the case 
of an exponential rate of convergence of (A r ) or (9 r ), all subsampling step m„ = 0(n a ) with < a < 1 
could be used: it is the case for instance for GARCH(p, q) processes. 

4.3. Kernel density estimation 

Let (JQ)jgN be a sequence of stationary zero mean r. v. (with real values) such that Xo has a 
marginal density fx with respect to Lebesgue measure. Let K : M — > K be a kernel function satisfying, 

Assumption K: K : M. — > K be a bounded and Lipschitz function with K{t) dt = 1. 
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Now, define (h n ) n eN a sequence such that h n — ► and consider the usual kernel density estimation, 



i— 1 x ' 



X € 



Proposition 4.2. Let (X,)j e z &e a stationary zero mean weakly dependent time series (with real 
values) such that X has a marginal density fx with respect to Lebesgue measure. Assume that 
\\fx\\ < oo andmax-ijij \\fi,j\\oo < °°; where foj denotes the joint marginal density of (Xi,Xj). Then, 

y/^(f£\x)-Ef£\xj) ^ U(0,fx(x) f K 2 (t)dt), 

V 7 n->oo V JR 7 

if h n — ► 0, nh n — > oo and, 

n—>oo n—>oo 

• h n = o(n" 2 /l A ^Aii" 5 " 2A ^) when (Xj) ie z is a X-weakly dependent process with A r = 0(r~ x ) 
and A > 5, or 

• when (Xi) ie z is a 9-weakly dependent process with 9 r = 0(r~ e ) and 9 > 3. 

Now, following the regularity of the function fx , Ef^f 1 (x) is a more or less good approximation of 
fx(x)- Hence, here there are two different cases of the approximation of the bias, 

Corollary 4.1. Assume that the function fx is a C P (R) function, with pel*. Then, under the same 
conditions than Proposition 4-2, with K a kernel such that J R K(t)t q dt = for q = {1, . . . ,p — 1} 
and J R K(t)t p dt ^= 0, if h n = C ■ n _1 /( 2p+1 ) (with C > 0) and, following the different frames of weak 
dependence, A > bp + 5 or 6 > 3, 

~n (fx l) (*) - fx (x)) ^ Miff (x) - [ t*>K{t) dt , fx (x) 

v 7 n^oo v P- JR 



Vnhn (f { x ) (x)-fx(x)) Mi fx (x)— / t*K(t)dt,f x (x) / K 2 (t)dt). 

V 7 n^oo V P- JR JR 7 

Corollary 4.2. Assume that the regularity of the function fx is p > with p £ N* (in the sense that f 
has a [p]-th order bounded derivative which is Holder continuous with exponent p— [p]). Then, under the 
same conditions than Proposition 4-2, with K a kernel such that J R K(t)t q dt = for q = {1, . . . , [p\ — 1} 
and J R K(t)t^ dt ^= 0, if h n = o(n _1 /( 2 ^ +1 )) and, following the different frames of weak dependence, 
A > b[p] +5 or 9 > 3, 

V^K(f i x\x)-fx(x)) M(0,fx(x) [ K 2 (t)dt). 

V 7 n^oo V JE 7 

4.4. Subsampled kernel density estimation 

Now, imagine that the process (Xk)k&z is a weakly dependent zero mean stationary process such 
that the conditions A > 5 or 9 > 3 of Proposition 4.2 are not satisfied. As a consequence, the kernel 
density estimator is not proved to satisfy a central limit theorem. Subsampling can provide a way 
for obtaining a C.L.T. (and then, confidence intervals or goodness-of-fit tests). Indeed, like it was 
also considered before, a subsampled time series with an asymptotic rate is "less" dependent than the 
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original time series. Indeed, consider a sequence (m„)„ e N such that 

m„ — ► oo and k n — [n/m n ] — > oo, 

n— *oo n^oo 

and the subsample (I TOll , . . . ,Xk„ m „) of (Xi, . . . , X n ). For (h n ) ne ^ a sequence such that h n — ► 0, 

n— ►oo 

define the subsampled kernel density estimator of /x as: 

f£' mn) ( x ) = -Lj2iT K ( x -* im A for 

Proposition 4.3. Under the same assumptions than Proposition 4-2, except that < A < 6 or 9 < 3, 
the following C.L.T. yields from the subsample (X mn , . . . , Xk nTrin ), 

V^Apr-'W-Et'™"'^ tf(0Jx(x) [ K 2 (t)dt), 

V 7 n^oo V JR ' 

for sequences (h n ) and (m n ) such that h n = n~ h and m n — n m , where the points (m,h) are in the 
"white zonas" (included in square (0, 1) 2 ) of Figure 1 and 2 (see below). Moreover, the "optimal" 
convergence rate is obtained for, 

• \Jh n k n = rj5+2(Avi> ~ e for all e > small enough (and h n — n~ e and m n = n 5 + 2 < Avl > +e ) when 
(Xi)i£z is a X-weakly dependent process; 

• y/h n k n = n^ eA1 ^ e for all e > small enough (and h n = n~ £ and m n — n^ 1-9 ^ ^ 5 ) when 
(Xi)i € z is a 0-weakly dependent process. 

From this result, we now answer to the following problem. Assume that X is a 9- (or A-) weakly 
dependent process and that the regularity p (in the sense of the previous section) of the density 
function fx and the sequence decay rates 9 and A of the sequences (0 r ) r or (A r ) r are known. In 
the previous section, we have established a C.L.T. for the density kernel estimator when 9 (or A) is 
larger than an affine function of p. However, if this inequality is not satisfied, it is possible to find a 
subsampling step such that a C.L.T. for the subsampled kernel density estimator can be proved, 

Corollary 4.3. Under the assumptions of consequence 4.1, but if < A < 5p + 5 (or < 9 < p + 3), 

Vk^(f i x' mn) (x)-f x (x)\ Afff ( p( x )l [ t»K{t)dt,f x {x) I K 2 (t)dt), 

with the following optimal conditions, 

_ x A 

• for X-weakly dependent process, with X r — 0(r ) and < A < 5p + 5, for h n — n s+ p (s+2(avi)) 

1 A(2p + 1) . pA 

and m n = n 5+ P (5+2(avi» _ Then, the convergence rate is \/k n h n ~ fj5+ P (5+2(Avi)) ■ 

_a e 

• for 9-weakly dependent process, with 9 r — 0(r ) and < 9 < p + 3, for h n — n 3+2p(»vi) an d 

1 f(2p+l) , P 9 

m n = n 3+2p(«vi) _ Then, the convergence rate is yk n h n ~ n 3 + 2 p< evl > . 

Corollary 4.4. Under the assumptions of Consequence 4.2 with p ^ N 7 but if < A < 5[p] + 5 (or 
< 9 < [p] + 3), then, 

VKK(f x x ' mn) (x)-f x (x)) Af(0,f x (x) f K 2 (t)dt), 

V ' n—>oo Jr 
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with the following conditions (for all e > small enough), 

• for \-weakly dependent process, with X r = 0(r~ x ) and < A < 5[p]+5, for h n — n~ s+TpTTs+stavTJ) 

1 I o- M2|>1+1) i PA 

and m n = n + 5 +w( 5 + 2 ( Jvl » . T/ien, the convergence rate is \/k n h n <~ n 5 +w< s + 2 ( Avl » ; 

• for 9-weakly dependent process, with 9 r = 0(r ) and < 9 < [p] + 3, /or h n = n s+triwtj 

1 I o- e(2[ P ] + i) , [pie 

and m„ = n 3+2^(^1) _ ^ e convergence rate is \/k n h n ~ n 3 + 2 i*K evl ) £ . 

Hence, for all regularity parameter p > 0, even if A or 9 are very small numbers (for instance when 
X is a long range dependent process), the subsampled kernel density estimator satisfies a C.L.T. for 
a fitted choice of h n and m n . Moreover, for ^-weakly dependent time series with 9 > 0, when p — > oo, 
the convergence rate of this theorem is n 1 / 2-6 , with e > 0. 



5. Proofs 



Proof of Lemma 1. For fc e N*, we first notice and prove that, 



At < A 



fe,i 



(8) 



with A M - E^Wi+XO-MWi+yO) . for*e{l,...,fc} 
Wi = + + and Wi=0, for i e {2, . . . , fc}, 

= E(/(t + y +1 +---+y fe )) and f k (t) = f(t), forte 



and i e {1, . . . , k — 1}. 



Let x, w € R d . Taylor formula writes in two following ways (for suitable vectors wi, x ,W2,x € 



= f(w) + f (1) (w)(x) + \ f (2 \w)(x,x) + i f (3) (w 2 , x )(x,x,x), 

where, for j = 1,2 and 3, f^\w){y\, . . . , y^) stands for the value of the symmetric j-linear form 
of (j/i, . . . , y,) at w. Moreover, denote, 

||/«H|| 1= sup \fW(w)( yi ,..., yj )\, ||/«||oc= sup 

Il2/i||,-,llaill<l w£M d 

Thus for w,x,y e M d , there exists some suitable vectors Wi jX , «^2,x) ^2,3/ € K d such that: 

f(w + x)-f(w + y) = f (1 \w)(x-y) + ±(f^(w)(x,x)-fW(w)(y,y)) 

+\ ((f (2 \m, x ) f (2) (w)){x,x) (fW(w hy ) fW(w))(y,y)) 
= fW H (x-y)+ l - (/W («,) (x, x) - / < 2 > (tu) (y, y)) 
+ i (/ (3) (w 2 , x )(x, x, x) - f^ (w 2ty )(y, y, y)) . 
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Thus, -y = f(w + x)-f(w + y)-fW(w)(x-y)-$ (f^(w)(x,x) - f^(w)(y,y)) satisfies 
|7l < ((lkl| 2 + l|y|| 2 )ll/ (2) llco) A(i(||x|| 3 + || 2 ;|| 3 )||/( 3 )|| 0O ) 

< ll/ (2) ll~ {lkl| 2 (l A I J^INI) + N| 2 (l A I J^NI)} (9) 

< ^ll/ (2) ll^ll/ (3) llL{bll 2+5 + bll 2+5 } (io) 

using the inequality 1 A c < c 5 , that is valid for all c > when 5 e [0, 1]. Now, this inequality could be 
applied to the functions fi and r.v. Yj and W k . Indeed, 

fi(Wi + Xi) - fi(Wi + Yi) - fW(WMXi -Yi)-± (/< 2 >(Wi)(Xi, X t ) - fQ\Wi){Y u *•)) 

= fi(W i +X i )-f i (W i + Y i ) 

because Wi is independent from Xi and Yi and because E(JQ) = E(Yj) = and Cov(Xj) = Cov(Fj). 
Thanks to the inequalities ||/^||oo < ||/^||oo (valid for 1 < i < k and < j < 3) and (10), we obtain, 

am < ^ ii/ (2) ii^ii/ (3) nfo {eii^ii 2+5 + nm\ 2+5 } . 

But, E(||Yi|| 2 + <5 ) < (E(||K t || 4 ))3+! andEdl^H 4 ) = 3 • E 2 (||Xi|| 2 ) because Y t is a Gaussian r.v. with the 
same covariance than X t . Therefore, E(||r,|| 2 + 5 ) < 3* + 1 | ^ || 2+<5 )) 4 ( ^ +1 )/(2+<5) < 35+!e(|| A 4 || 2 + 5 ). 
As a consequence, from assumption (2), 

k 

A, < ^||/ (2) ||^ll/ (3) llLE{lE(ll^l| 2+5 )+IE(ll^l| 2+5 )} 



< (1+ 6 3 ; +5) ^-ii/ (2) n^ii/ (3) iigc 

< 3.A fe .||/( 2 )||^||/( 3 )||^. □ 

Proof of Remark 1. Set b\ = ma Xl < 4 < fe E(|| A 4 || 2 ). Now, for e < 6 ||/( 2 )|U • (H/^IU)" 1 , and using 
inequality (9) and 1 A c < c for all c > 0, one obtains 

Am < ||/( 2 )|| 00 e(||x < || 2 a 1 (II/^IU)" 1 !!/^!^ • ll^|| 3 )) + \ n/^iUEdi^n 3 ) 

< H/^IUEdl^H 2 ^!!^!!^) + i H/^IU • (e(||X 4 || 3 1 { || Xi ||< £} ) +E(||r 4 || 3 )) 

< ll/^IUEdl^ll 2 ^!!^!,^) + i H/^IU • (e • E(||A 4 || 2 ) + 3 3 / 4 (E((||A 4 || 2 ) 3 / 2 )), 
from the Holder Inequality. It implies that, 

k 

A k < ||/( 2 )|| 00 B fe ( £ ) + I||/(3)|| 00 ( £ .a fe + 3 3 / 4 E6 fe -E(||X i || 2 )) 

< ||/ (2) ||coi? fc (e) + I ||/ (3) ||co • a k (e + 3 3 / 4 • b k ). 

Moreover, b\ < e 2 +maxi<i< fe e(J|X;|| 2 1 { || X .|| >£} ) , therefore b\ <e 2 +B k (e) and thus b k <e + y/B k {e). 
As a consequence, 

A fc < \\fW\\ooB k (e) + \\fW\\ x -a k (^s+±^/B^y □ 
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Proof of Lemma 2. Consider (X*) ie jq a sequence of r.v. satisfying Assumption H$ and such that 
is independent of and (i»)»eN- Moreover, assume that X* has the same distribution 

as Xi for i e N. Then, using the same decomposition as in the proof of Lemma 1, one can also write, 

A fcli < |E (fi(Wi + Xi) - fi(Wi + X*))\ + \E (fi(Wi + X*) - fi(Wi + Yi)))\ . 

From the previous Lemma, 

k 



]T IE (fi(Wi + X*) M Wl + Yi))\ < 3 • Wf^W 1 - 5 ■ \\f^\t ■ A k . 

i=l 

Moreover, the bound for 7 of the proof Lemma 1 entails, 

Ifm + Xi) - fi(w i + x*)\ < \fP(Wi)(Xi)\ + \ |/f \Wi\XuXi) - fM(Wi)(x;,x;)\+ 

+ ^ll/ (2) llL- 5 ll/ (3) llfo{ll^ll 2+5 + ll^ll 2+5 }, 

because (Xi) is now supposed to be a dependent sequence of random variables and is no more 
independent from (Wj). But with the notation before Lemma 2, we may write 

k k 



Y J W1 1 \W 1 ){X 1 )\^T 1 and £ |e (/f \Wi)(Xi,Xi) - /f \Wi){X* , X*)) 



i=l 

It implies that, 



i=l 



To. 



A fe <T 1 + ir 2 + 6.||.f( 2 )||^-||/ (3) |lL-^. □ 



Proof of Lemma 3. Here, for t € K d , f(x) = e l<t ' x> . Denote Vi — VarJQ, the covariance matrix of 
the vector Xi. Then, for a r.v. Z independent from (Yi) ie ^, 



Efj(Z)=E(f(Z + Y j+1 



Yk)) 



Then, again 



A fcJ < \E(fj(Wj + X,) - fjiWj + X*))\ + \EifjiWj + X*) - friWj + Y j )) { , 



with the second term bounded as in the proof of Lemma 2 with H/^H^ s ■ \\f^\\to = \\t\\ 2+s , and for 
the first term, 

EifjiWj + Xj) - fj(Wj+X*)) = e -it'-(v j+1 +-+v k yt , E ^<t,w 3 >^<t,x 3 > _ ^<t,x;>^y 



\EifjiWj + Xj) - fjiWj + X*))\ < 



±t'-(y j+ i+-+v k )-t 



|Cov(, 



,i<t,Wj> l<t,Jf 3 >N 



□ 



Proof of Proposition 4-1- The proof of this proposition is a consequence of Theorem 1, using T(n) 
In one hand, thanks to the stationarity of the sequence (Xi)i^z, 

k n 



A fe „=^E(||^„|| 2 + 5 )=fc- 5 / 2 E(||X 



0. 
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In the other hand, a bound of T(k n ) can be provided. Indeed, let t G M d , and then, 

fen-l 

T(k n ) = ^ |Cov( e l<t ' yi +-+ y - 1 >,e l < t ^>)|, 
i=i 

k n 1 

= J2 \Gov(F t , n (X 1 ,...,X j _ 1 ),G t , n (X j ))\, 

with G t , n (sj) = exp(i < s,t > /\/k^) and F ti „(si, . . . , Sj-i) = G t , n {si) x ••• x G t , n {sj-i) for 
(si,...,Sj) e But, 

||G t , n ||oo < 1 and LipG t ,„ < ||i|| • fc~ 1/2 

llJt.nlloo < 1 and LipF t ,„ < \\t\\ • fc- 1/2 , 

from inequality \u\ x • • • x — v\ x • • • x Vj-\\ < \u\ — v\\ + ■ ■ ■ + \uj-\ — Vj-\\ , valid for complex 
numbers Ui,Vi with modulus less than 1. Therefore, under the different frames of dependence, 



Dependence 


|Cov(F t ,„(Xi,. 




T(fc„) 


e 


< 11*11 


•A;- 1/2 


< \\t\\-k 1/2 e 


A 


< 11*1 




< Hill -fc 3/2 A 

||t|| ft-n A mji 


and then, Theorem 1 implies 


Proposition 4.1. 


□ 





Proof of Proposition 4-2. Let x G M, define, 

n 

S n = ^h n (& n) (x) - E/W (a;)) = £ y 

i=l 

and the function u depends also on x and n. First, for 6 > 0, 

n 

a„ = ]TE(||y|| 2 + 5 ) 

- <"«- ,/2 -MK^)-K^))r) 

< 2-(n^„)- 5 ' 



< 2.(n/, Il )- 5 / 2 .||/ x ||co- / \K(s)\ 2+S ds. 



(the boundedness of K implies the convergence of the last integral). As a consequence, A n — ► 

n^oo 

when nh n — > oo. Now, 



|E(y)| < ||/x||oo / \u(s)\ds 
2h n 



< 



2 ^\\fx\\oo [\K(v)\dv 
/nh n J 



< Gj h -, 
V n 



for some constant C\ > 0. 



(12) 
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Moreover, using changes in variables v = (x — s)/h n , v' = (x — s')/h n , 

Cov^F;) = / u( S )u(s')(f jti (s,s')-f x ( S )f x (s'))dsds' 
Jr 2 

|Cov(^)| < (WhiWoo + WfxWl) f \u(s)\\u(s')\dsds' 

JR 2 

< ^(||/i,i||oo + ||/x||L)(/ \K(v)\dv^j 

for some constant C2 > 0. 



< C 2 ^, 
n 



(13) 



The function K is supposed to be a bounded and Lipschitz function, the same for u, 



lulloo < 2IIA-I 



1 



and Lip u = 2 Lip K ■ 



1 



\fnhn ' h n y/nh n 

Therefore, using the ?7-weak dependence inequality of the time series with always Yi = u(Xi 



there exists C > such that, 



|Cov(Fo,^r)| < C ' U n ,r with U 7ltr = < 



nh n 



for the 0-wcak dependence 



—j for the A-weak dependence 
k nh n 

As a consequence of both (13) and the previous inequalities, there exists constants C 3 > such that 

|Cov(Y , Y r )\ < C 3 ■ ( — A u n r ), for all r e N. (14) 
V n ) 

Finally, we also quote that for i <E N, 

VarOS) = / f x (t)-u 2 (t)dt 

JR 



n 



fx(x - /i„s) • -ftT 2 (s) ds. 



From the assumptions on functions fx and if, the Lebesgue dominated convergence Theorem can be 
applied and therefore, 



n-Var(V 4 ) — [ f x (x) ■ K 2 (s) ds. 

n^oo JR 

Using the relations (12), (14) and (15), then, 

Var (S n ) = n • Var Y + 2 ^ (n - i)Cov(Y" , F) 

i=l 

^ n— 1 

nh n ■ Var (/£°(a0) - f x (x) / i^ 2 (i) dt < o(l) + 2C 3 • ]T (/i„ A (n • «„, r )) . 



(15) 



n-l 



i=l 



Under the assumptions of the Proposition, if the right term of the forthcoming inequality (17) converges 
to 0, the right term of the previous inequality converges to and thus, 



nh n ■ Var 



(#>(*)) 



f(x) / ^ 2 (t)di. 



(16) 
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Now, we are going to bound T(n) for applying Lemma 3. Let i£l and tel. First we can write, 



n-1 



T(n) = J2 \Cov(F Xtt (X u . . .,*,•_!), G x , t (Xj))\ , 
i=i 

where F X)t (Xi, . . . , -Xj_i) = cxp (it(Yi + • • • + 5-j-i)^ and G Xi t(Xj) = exp (itY,), with always Yfc = 
u(-X'fe). In order to compute a bound for T(n) we need the following decomposition due to Rio (2000), 

E< 

*;=i 

Thus, 

Cov(F Xlt (Xi, . . . , Xj-i), G x , t (Xj)) = ]T Cov{e itS " - e us ^ , 



F X!t (X u ...,X j _ 1 ) = J2(e its « -e its *-i), with S k = Y 1 + ■ ■ ■ + Y k and S* = 0. 



3-1 



fe=l 



Consider a r.v. Y? independent from (Yi, . . . , Yfc_i), with the same distribution than Yj. Then, 



Covf e* tSfc - e" 5 *- 1 , e i4i J 



e <ts * -e its *- 1 )(e <t ^ -e"V)) 



< |t| 2 E(|Y fc | • (\Yj\ + |Y/|)) from inequality \e m - e lb \ < \b - a 

< C— , for some constant C > 0, 

n 

from relations (12) and (14). From another hand, one can write, 

Cov (e ttS « , e ity < ) - Cov (g x (X 1 , . . . , X k ), g 2 (X,)) , 

with ||^ 2 ||oo = 1 and H^IU < |t|||S fc - Sfe.ilU < \t\ • II^IU < 2|t|||A-|| 



and, 



< t- 



(u(a;i) H h w(z fe )) - (u(?/i) H h u(y fe ))| 



pi - 2/i M h Ffe - Vk\ 



| e »t(u(a;i)H h«(x fc )) _ e it(u(yi)-\ h«(y fc )) | 

- 2/1 H h |ajfe - Dk\ 



As a consequence, Lip gi < 8\t\ ■ Lip if 



results and the weak dependence property of X, there exists C > such that for I = j — k € [1, j], 



< \t\ ■ Lipu • k. 

k 



and Lip 52 < 4|t| • Lip if • 



1 



= . Using these 



with v nMtl 



< C ■ — A v n .k,t 
n 



1 

nhl 



ence 



k 2 i—r-T V - j- \ ■ Xi for the A- weak depend 

\nhl n i/2/j3/V 

for the #-weak dependence 



This implies, 



n 3 



T(n) < CJ2J2~ AV ^ 

n 

< h n A (n ■ v n ,n,e) 

n 



(17) 
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with (3 > (analogously to the case of Var f^\x)). Since nh n — ► oo and h n — > 0, one obtains 

n — >oo n — >oo 

that T(n) — > under the different conditions satisfied by h n and the weak dependence sequence. 

n — >oo 

Then, all the conditions of Theorem 1 are satisfied, which implies Proposition 4.2. □ 
Proof of Corollaries 4-1 and 4-2. Under the assumptions on K, from Prakasa Rao (1983), 

fx{x) + h p n ■ (1 + o(l)) • f$\x) — I t PK (t) & if thc regularity of f x is p e N* 

P- Jw 



E 



(ft B) («)) 



/x (x) + 0(hjfl ) if the regularity of fx is p ^ N* 

It implies the optimal choice of convergence rate of h n , following this two cases, and the conditions on 
the convergence rates of the different frames of weak dependent. □ 

Proof of Proposition 4-3. This proof is quite the same than the proof of Proposition 4.2 and therefore 
we omit the details. Let x e M, define, 



where Yi 



1 



K 



»=1 

x - Xi. 



V V h„ 



\fk n h n 

and the function u depends both on x and n. First, for 6 > 0, 

fcn 

^E(||r 4 || 2 + 5 ) <2-(k n h n ) 



u(X imn ), (If 



5/2 • II/. 



X oo ' 



|if(s)| 2+ ^s. 



As a consequence, A^ 71 ^ 



TO) | < Ci 



when fc„ft n — > oo. Moreover, we have, 

n—>oo 

h n 



k ' 

h n 



for some constant C\ > 0; 
|Cov(Yb, Y r )\ < C3 • (jp- A Uk n ,m n -r) , for some constant C3 > and all r e N, 
with the sequence (u p , q ) defined in thc proof of the Proposition 4.2. We have also, 

fc„-Var(r 4 ) — » [ f x {x)-K 2 (s)ds, 

. k„-l 

and thus fc n /i„ • Var (J^ ,mn) (x)) - f x (x) / if 2 (t) dt 
der the conditions on /i„ and m n , 

fc^-Varf/^""^)) — f(x) [ K 2 (t)dt. 

V 7 71— >oo JR 

For bounding T(k n ), one writes again with Sk = Y\ + ■ ■ ■ + Yk and So = 0, 

i-i 



< o(l) + 2C 3 • (/i„ A (fc„ • w fen , mn . r )) . Un- 



(19) 



k„-l 
T(k n ) = £ 

Thanks to thc inequality, 

Cov(e itS » -e^- 1 ^^'') 



E Cov ( 



fc=l 



C 



for some constant C > 0, 
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and with the sequence (y n ^,i) of the previous proof, this implies, 



T(k n ) < C ■ ^ i h n A (k n ■ Wfe„,fe„, m „£) 





k n ,k„ 



(=1 



with P > 0. With h n = rr h and 'm-n = n m , where h,m £ (0, 1), the condition T(k n ) — ► 0, which 

n — *oo 

implies (19) and therefore the central limit theorem, can be obtained for different choice of h and m. 
After computations, the following graphs provide the zonas (depending also of the decay rate 8 or A 
of weak dependence property) where h and m can be chosen, 





Figure 1 : Conditions (the "white" zona) satisfied by parameters m and h for obtaining the C.L.T. 
in the 0-weak dependence frame, when < 9 < 1 (left) and 1 < 9 < 3 (right). 





Figure 2 : Conditions (the "white" zona) satisfied by parameters m and h for obtaining the C.L.T. 
in the A- weak dependence frame, when < A < f (left) and 1 < A < 6 (right). 
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Finally, the "optimal" rate of convergence, in the sense of a maximal \/k n h n = n^ m ^ h ^ 2 , is obtained 
from a maximization oil — m — h. In every cases this occurs for the point (m, h) most below and left 
of the graph "white" zona. This implies the optimal condition of the Proposition. □ 
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